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ABSTRACT 

A study was Dade to: (1) describe a series of 
procedures designed to assess the need for a new preschool television 
series; (2) achieve consensual validation of the procedures to be 
used in the series of studies; and (3) discuss the Dan^iV^aent 
procedures and organizational probleas involved in the coapletion of 
the studies. The* general nethods used for the needs and capability 
docuaentation were: (1) to review appropriate literal-are; (2) to 
develop criteria for a preschool televisi-^n prograo; (3) to measure 
the reaction of children to different television prograas; and (a| to 
get reactions based on the criteria to the proposed prograa froa the 
various consuaer groups. Initially, there was difficulty in obtaining 
consensus concerning the priaary focus of the studies. Nevertheless, 
the studies concluded that: (1) a preschool television series was 
needed and that the Appalachia Educational Laboratory was capable of 
developing such a series; (2) aany of the procedures, such as the 
aeasuring of children's interest in television prograas, were very 
effective; (3) other procedures, such as atteapts to aeasure consuaer 
groups* reactions to children's television programs, were not only 
effective, but also yielded benefits of a diffusion nature beyond 
those of singularly assessing product effectiveness. (BCH) 
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Description of Procedures Used to Indicate the 
Need for a Preschool Television Series 

Effective December 1, X972, the Appalachia Educational Laboratory was 
commissioned by the director of the National Institute of Education to "docu- 
ment the need for and capability of (AEL*s) development of a television program*'. 
If evaluated positively by the NIE review panels, the documentation could lead 
to development of a Home-Oriented Preschool Education program (HOPE) , which 
would include a television series and an expected funding level of roughly six 
million dollars for a four-year development effort. 

Of central importance to the program was that a new television ser\«is should 
b»^ developed for the Appalachian Region rather than using Sesame Street, Captain 
Kangaroo, or some other children's television program. 

The series of studies was completed by June 1, 1973 • The findings of the 
studies are of secondary importance to this discussion and can be found in the 
technical reports given in the attached list of references. Of primary impor-- 
tance are the procedures usedy the management strategies employed, the problems 
encountered, and the general trauma felt by a research division in attempting 
comparatively fast-paced needs and capability studies. 

Object i t^ ?s for the Presentation 

The objectives for this presentation are: 

1. To describe a series of procedures designed to assess the need 
for a new preschool television series. 

2. To achieve consensual validation of the procedures used in the 
series of studies. 

3. To discuss the management procedures and organizational problems 
involved in the completion of the series of studies. 

The research discussed in this paper was conducted by the Appalachia Educa- 
tional Laboratory, Inc. pursuant to Contract No. NE-C-00- 3-0094 with the National 
Institute of Education, U. S. Department of Health, Education, and Welfare. The 
opinions e::pressed in this paper do not necessarily reflect the rosi^-ion or policy 
of the National Institute of Education and no official endorsement by thac office 
should be inferred. The Appalachia Educational Laboratory, inc. is an equal 
opportunicy employer. 
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Assumptions on Which the Studies Were Baaed 

Need was cc^sidered to be a value judgment of the intended clientele for 
a program and^ other than the dhild^ren th^nselves, the sources for indication 
of a needed preschool television program were: 

1. Representatives of academic disciplines, such as early childhood 
education, child psychology , &nd researdi. 

2. Representatives of regulatory and service institutions including 
state education agencies, local school systems, and certain federal 
agencies • 

3. Television specialists primarily associated with children's tele*- 
vision programs. 

4. Parents of preschool children. 

The determination of an educational need was considered to require the 
following: 

1. Provision of information to representatives of the target population 
(mentioned previously) - 

2. Designation and implementation of procedures whereby these repre- 
sentatives can react, interact, and achieve consensus. 

3. Assessment and documentation of the values associated with proposed 
concepts, programs, or products. 

Methods and Data Source 

The general methods used for the needs and capabi3.ity documentation for 
the preschool children were (1) to review appropriate literature, (2) to derive 
and develop criteria for a preschool television program, (3) to measure the 
reaction of diildren to different televisioi programs, and (4) to get reactions 
based on the criteria, to the proposed program from the various consumer groups. 
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An extensive literature review was directed toward explicating the pre- 
school needs of children and describing a theoretical base on which the entire 
HOPE system is based. 'Hio wc Rs of Skinner (1966) , Butler (1971) , Woolman (1971) , 
Coleman (1966), Gordon (1969) , arad others were used in formulating a theoretical 
base. In addition , selected demographic and marketing data were assembled for 
use by the consumer representatives. The Television Factbook (Warren, 1972) , 
and U. S. census data (1972) %#ere primary sources* of demographic and marketing 
data. Ihese data were systematically collected c \ : ised to give representatives 
of the consumer groups an indication of basic ;ieed-^ -;f preschool children. 

The representatives of the consumer groups t*c i convened to assist the AEL 
staff with formulating criteria for a preschool television series according to 
a process similar to one advocated by the UCLA Center for the Study of Evaluation 
(Klein, 1971) « Specialists in preschool education and children's television, 
including Robert (Captain Kangaroo) Keeshao, Rose Mukerji, I^rtha Rauhid, Herbert 
Sprigle, Don Hamachekr and Eugene Wenger, were convened as representatives of 
academic interests in preschool education. Representatives from se/en State 
Education Agencies were also convened as a separate panel. Through face-to- 
face group interaction f some fifty-seven suggestions for requirements of a pre- 
school television series emerged* These were recorded, synthesized, and cate- 
gorized into a list of nine statements of criteria. The criteria were submitted 
to the different groups to obtain consensus among them and certain changes in the 
criteria were based on their recommendations. 

Currently available children's television programs, such as Captain Kangaroo 
and Sesame Street, were shewn to children of ages three, four, and five. The 
percent ol attention and number of overt responses to various taped segments 
were systematically recorded and analyzed by procedures similar to those used 
by Reeves (1970) and Sproul (1973). Two demonstration tapes representative of 



the proposed series were produced by AEL, and similar data vrere collected from 
the children as they observed the new tapes. The rate of attention to different 
types of tape segments, such as monologue or puppetry, was presented as graphic 
profiles in order to permit visual comparisons of demonstration tape results 
with those of the commercial programs. 

In order to assess the capability of the Laboratory to produce a new tele- 
vision series and as further indication of the need for a series, representatives 
of various consumer groups were asked to rate the demonstration tapes according 
to the nine criteria previously established. The consumer groups were the 
previously mentioned academic representatives and early childhood specialists 
representing the State Education Agencies in the Appalachian Region. Also, 
representatives of commercial television and representatives of educational 
television broadcasters were reiuested to assess the tapes. 

The different reviews and assessments were combined into a summary document 
and ten supporting technical reports (see attached list) according to a produc- 
tion schedule established n'^ar the beginning of the project. These reports 
were presented, both physically and verbally, to an NIE review panel convened 
by that agency for the purpose of making recommendations concerning funding. 

The six^ember NIE review panel completed their evaluation of the series 
of studies along with other aspects of the program and reported both verbally 
and in writing to NIE staff. The NIE staff members who summarized the reactions 
of the review panel gave the series of studies a mixed report. On the positive 
side, the NIE review p£mel was reported to feel that the "need for educational 
support was. . .evident, and no existing television program would conceivably 
serve in the p^ace of the new (television) series**. They further stated that 
the "underlying concept %aas good, but needed a more thorough and complete 



exposition** f although eleven reports requiring 347 pages of narrative, graphs, 
and tables were produced by four professional staff members within six months. 
Other negative comments were that the needs study statement "was felt to be 
generally inadequate in that it did not fully indicate how the curriculum fits 
the characteristics of the fairily, nor was there a thoughtful analysis of the 
educational needs of the area, the needs of the children, or of the way children 
develop**. A continuation in funding was recommended, but less than the level 
anticipated by the Laboratory staff. 

Results and Conclusions 

A major report with ten supporting technical reports was produced and 
transmitted to the appropriate agency within a designated period of six months. 
In retrospect, the most serious problem with the studies was the gross discrep- 
ancy between the Laboratory staff's understanding of the expectations of the 
funding agent and the review panel's expectations which emerged during the 
**site" reviews. The Laboratory position was that previous review panels had 
examined the HOPE concept and field test results, and that the purpose of the 
present needs studies v^s only to demonstrate the requirement for a new child- 
ren's television series which would become a part of the preschool program. 
The report from tlie review panel indicated that the need for a new television 
series was effectively demonstrated. 

Effective input was received from all the listed consumer groups except 
from parents. The attempt to measure the reaction of parents was aborted 
because of a low percentage return from hand delivered questionnaires, and 
because there was not time to find some alternative procedure for obtaining 
parents' reactions. 

Several other problems were encountered during the conduct of the studies. 
Initially, there was some difficulty with obtaining consensus concerning the 
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design of the studies. Some Laboratory staff preferred a cost benefit analysis, 
%rt)ile others envisioned production of a public relations-type document. An 
even more serious problem was difficulty in obtaining consensus concerning the 
primary focus of the studies. For example* should the focus of the studies be 
on only a television series or on the entire Home-Oriented Preschool Education 
system of preschool education" lere was also considerable difficulty obtaining 
consensus on a specific uefini*;ion of the population. Was it all Appalachian 
children or rural Appalachian children? 

Another concern was difficulty with finding an appropriate balance bet««een 
the diffuser*s tendency to overstate results and the researcher's tendency to 
understate findings. 

The conclusion of the studies was that a preschool television series was 
needed and that the Laboratory was capable of developing such a series. The 
conclusion from conducting the studies was that many of the procedures, such as 
the measuring of children's interest in television programs, were very effective. 
The use of other proceduses, such as attempts to measure parents* reactions to 
television programs, was not effective. Some procedures, such as attempts to 
measure consumer groups* reactions to children's television programs, were rot 
only effective from a pure evaluation point of view, but also yielded benefits 
of a diffusion nature b««yond those of singularly assessing product effectiveness. 



References 



liuieau of the Census. 1^70 Con^;us of Population, Ocnoral Social and 
K conomic Characteristics t United States Summary . Wash i nqt on , D . C . ! 
bureau of the Census, 1972 » pp« 386-7. 

Butler f Annie. Literature Search and Development of an Evaluation System 
in Early Childhood Education; Research Characteristics of Presdiool 
Children . Bloomington, Indiana: Indiana University, 1971. ED 059 78C 

Coleman, James, et al. Equality of Educational Opportunity. Washington, 
D.C. : U. S. Government Printing Office, 1966. 

Gordon, Ira J. "Developing Parent Power," liidith Grotberg (Ed.). Critical 
Issues in Research Related to Disadvantaged Children * Princeton, New 
Jersey: Educational Testing Service, 1969. 

Klein, Stephen P. Evaluation Workshop I: An Orientation . Monterey Park, 
CaUfomia: CIB/NcGraw-Hill, 1971. 

Reeves, B. The First Year of Sesame Street, The Formative Research, Final 
Report . New York: Children's Television Workshop, 1970. 

Skinner, B. P. "What is the Experimental Analysis of Behavior", Journal of 
Experimental Analysis of Behavior , (1966), 9(3) :215-216. 

Sproul, Natalie. "Visual Attention, Modeling Behaviors, and Other Verbal 
and Nonverbal Meta-Communication of Prekindergarten Children Viewing 
Sesame Street" , American Educational Research Journal , Spring, 1973, 
Vol. 10, No. 2, pp. 101-114. 

Warren, Albert. Television Factbook . Washington, D. C. : Television Digest, 
Inc. , 1972 , passim . 

Woolman, Myron and Ed.th ri. Grotberg. Educational Designs and Proposal for 
Early Childhood Research: A New Look: A systems Approach to Pre-School 
Education . Washington, D. C. : Office of Planning, Researc^t, and Evalu- 
ation, Office of Economic Opportunity, 1971. ED 053 809 



HOPE Needs and Capability Study References 

Appalachia Needs HOPE; The Need for and Capability of the Appalachia Educa~ 
tional Laboratory to Develop a New Presdtiool Television Program . Charleston , 
W. Va. : Appalachia Educational Laboratory, Inc., May, 1973. (Authors: 
Oiarles Bertram, Benjamin Bailey, Brt.inard Hines, Joe Shively, and Ermel 
Stepp) (ERIC No. to be assigned) 

Marketable Prestdiool Education Program Theoretical Base and Needs . Technical 
Report No. 24. Charleston, W. Va. : Appalachia Educational Laboratory, 
Inc., May, 1973. (Author: Ermel Stepp) 

Preschool Education Programs: An Analytical Comparison . Technical Report 
No. 25. Charleston, W. Va. : Appalachia Educational Laboratory, Inc., 
May, 1973. (Author: Benjamin Bailey) (£RIC No. to be assigned) 



ij o moq raphic and Marketing Data for the Marketable Presdiool Education Program . 
Technical Report No. 26. Charleston ^ W. Va. : Appalachia Educational 
Laboratory, Inc* , May, 1973. (Author; Ennel Stepp) (ERIC No. to be 
assigned) 

Selection of Criteria for the Home-Oriented Preschool Education Television 
Series > Technical Report No. 27. Charleston, W. Va.; Appalachia 
Educational Laboratory, Inc., May, 1973. (Author: Charles Bertram) 
(ERIC No. to be assigned) 

Children's Reactions to Types of Television Presentation . Technical Report 
No. 28. CSiarleston, W. Va.: Appalachia Educational Laboratory, Inc., 
May, 1973. (Author: Brainard Hines) (ERIC No. to be assigned) 

Commercial Television Personnel's Review of the Technical Quality and 

Marketability of AEL's "Around the Bend" Pilot Tapes . Technical Report 
No. 29. Qiarleston, W. Va. : Appalachia Educational Laboratory, Inc., 
May, 1973. (Author: Joe Shively) (ERIC No. to be assigned) 

State Department Early Childhood Education Program Specialists* Review of 
the Content and Technicaljjuality of AEL's ** Around the Bend** Pilot . 
Tapes . Technical Report No. 30. Charleston, W. Va. : Appalachia 
Educational Laboratory. Inc., May, 1973. (Author: Joe Shively) 
(ERIC No. to be assigned) 

Educational Television Personnel's Review of the Technical Quality r Content 
Criteria, and Marketability of AEL's "Around the Bend** Pilot Tapes 
Tedinical Report No. 31. Charleston, W. Va. : Appalachia Educational 
Laboratory, Inc., June, 1973. (Author: Joe Shively) (ERIC Nc to be 
assigned) 

Marketable Preschool Education Program Evaluation Plan . Technical Report 
No. 33. Charleston, W. va.: Appalachia Educational Laboratory, Inc., 
May, 1973. (Author: Joe Shively) (ERIC No. uo be assigned) 

Children's Reactions to Segments of a Children's Television Series . Techni- 
cal Report No. 34. Charleston, W. Va. : Appalachia Educational Laboratory, 
Inc., Jime, 1973. (Authors: Dick Cagno and Joe Shively) (ERIC No. to be 
assigned) 



